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Abstract 

We present a unified mathematical derivation of the asymptotic be¬ 
haviour of three of the main forms of directed transfer function (DTF) 
complementing recent partial directed coherence (PDC) results [3]. Based 
on these results and numerical examples we argue for a new directed ‘link’ 
centered neural connectivity framework to replace the widespread correla¬ 
tion based effective/functional network concepts so that directed network 
influences between structures become classified as to whether links are 
active in a direct or in an indirect way thereby leading to the new notions 
of Granger connectivity and Granger influenciability which are more de¬ 
scriptive than speaking of Granger causality alone. 


1 Introduction 

Introduced as a frequency domain characterization of the interaction between 
multiple neural structures directed transfer function (DTF) [16] can be thought 
as a factor in the coherence between pairs of observed time series [5]. A historical 
perspective on DTF by their authors can be found in [17] together with its many 
variants. 

On a par with it, stands partial directed coherence (PDC) [5] as its dual mea¬ 
sure. The chief distinction between them is that PDC captures active immediate 
directional coupling between structures whereas DTF, in general, portrays the 
existence of directional signal propagation even if it is only indirect, by going 
through intermediate structures rather through immediate direct causal influ¬ 
ence [6]. DTF, therefore, represents signal ‘ reachability ’ in a graph theoretical 
sense whereas PDC is akin to an adjacency matrix description [13]. 

Since DTF’s introduction, we examined two of its closely related variants 
(a) directed coherence (DC) [2] which is DTF’s scale invariant form (and dual 
to generalized PDC (<?PDC)[8]) and (b) information DTF (iDTF) which is an 
information theoretic generalization of DTF, dual to information PDC (tPDC), 
both of which provide accurate size effect information [26, 27, 28]. 
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In this paper, we derive and illustrate inference results for the above DTF 
variants from a unified perspective closely paralleling the inference results in 
[3] and further illustrated in [22] for PDC and its variants. The importance of 
accurate asymptotics for DTF is that jointly DTF and PDC allow extending 
the current paradigm of effective/function connectivity to a more general and 
informative context [7]. 

After briefly reviewing DTF’s formulations (Sec. 2) together with a summary 
of the unified asymptotic results (Sec. 3), numerical illustrations (Sec. 4) discuss 
some implications of the results as further elaborated in Sec. 5 with their 
implications for the new connectivity analysis paradigm we proposed in [7]. 
For reader convenience, mathematical details are left to the Appendix whose 
implementation is to appear in the next release of the AsynrpPDC package [3]. 


2 Background 


The departure point for defining all DTF related variants is an adequately fitted 
multivariate autoregressive time series (i.e. vector time series) model to which 
a multivariate signal x(n) made up by Xk{n), k = 1 simultaneously 

acquired time series conforms to 

p 

x(n) = A(Z)x(n — l) + w(n), (1) 

i=i 

where w(n) stands for a zero mean white innovations process of with S w = 
as its covariance matrix and p is the model order. The aij{l) coefficients 
composing each A (l) matrix describe the lagged effect of the j-th on the 7-th 
series, wherefrom one can also define a frequency domain representation of (1) 
via the A (/) matrix whose entries are given by 

( 1 - E aij(l)e~ i27rXl , if i=j 

Aij(X) = < p l=1 _ ( 2 ) 

— Y2 a.ij(l)e J 27rAi , otherwise 
l i=i 

where j = y/—T, so that one may define 

H(A) = A- 1 (A) (3) 


with Hij{ A) entries and rows denoted h ; . This leads to a general expression 


7ij(A) 


sHiM) 

v / hf(A)Sh i (A) 


(4) 


summarizing all the forms of DTF form j to i considered herein. The superscript 
H denotes the usual Hermitian transpose. The reader should be forewarned to 
use the adequate expression for s and S to obtain each DTF variant in (4) using 
Table 1. 
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Table 1: Defining variables according to DTF type in (4) 


variable 

DTF 

DC 

iDTF 

s 

1 

72 

i/2 

S 

I K 

(I/\ © £ w ) 

£ w 


3 Result Overview 

The statistical behaviour of (4) in terms of the number of times series data 
points (n s ) can be approximated invoking the delta method [30] consisting of an 
appropriate Taylor expansion of the statistics, leading, under mild assumptions, 
to the following results: 

3.1 Confidence Intervals 

In most applications, because n s is large, usually only the first Taylor derivative 
suffices. In the present context, parameter asymptotic normality implies that 
DTF’s point estimate will also be asymptotically normal, i.e. 

v^(l%-(A )| 2 - | 7 i i(A)| 2 ) 4 AA(0, 7 2 (A)), (5) 

where 7 2 (A) is a frequency dependent variance whose full disclosure requires the 
introduction of further notation and is postponed to the Appendix. 

3.2 Null Hypothesis Test 

Under the null hypothesis, 

H 0 : |7ij (A) | 2 = 0 (6) 

7 2 (A) vanishes identically so that (5) no longer applies and the next Taylor term 
becomes necessary [24]. The next expansion term is quadratic in the parameter 
vector and corresponds to one half of DTF’s Hessian at the point of interest 
with an Ofaj 1 ) dependence. 

The resulting distribution is that of a sum of at most two properly weighted 
independent Xi variables where the weights depend on frequency. Explicit com¬ 
putation is left to the Appendix given the need of specialized notation, but can 
be summarized as 

n s (hf (A)Sh i (A))(|%(A)| 2 - | 7 ij(A)| 2 ) 4 £ l k ( A)* 2 (7) 

fc=l 

where lk( A) are at most two frequency dependent eigenvalues (q < 2) coming 
from a matrix that depends on DTF’s values. Note that implicit dependence 
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also comes from the left side of (7) on DTF’s denominator. See further details 
in Proposition 2. Brief comments and explicit computational methods relating 
sums of xf variables may be found in [20], [14] and [25]. 

These results closely parallel PDC ones in [3], the main difference lying in 
how the frequency dependent covariance of the parameter vectors are computed. 


4 Numerical Illustrations 

In the examples that follow dashed lines indicate threshold values and gray 
shades stand for point confidence intervals around significant points. Unless 
stated otherwise, innovations noise is zero mean, unit variance and mutually 
uncorrelated. The frequency domain graphs are displayed in the standard form 
of an array where grayed diagonal panels contain the estimated time series power 
spectra. 

Example 1 Consider the connectivity from x\ -+ X 2 whose dynamics is repre¬ 
sented by an oscillator which influences another structure without feedback: 

x\ (n) = 0 . 95 \/ 22 i(n — 1) — 0.9025xi(?i — 2) + uq(n) 

X 2 (n) = — 0.5xi(?i — 1) + 0.5x 2 (n — 1) + io 2 (n) ( 8 ) 

As in all bivariate cases, DTP and PDC coincide numerically, yet because 
DTP computation requires actual matrix inversion in the general case, its null 
hypothesis threshold limits are affected by the spectra (top panel in Fig. 1) (the 
Xi(n) in this case) casting decision doubts at n s = 50 points (mid panel) as 
opposed to the PDC case (bottom panel). 

At n s = 500, DTP is above threshold for x\ —> X 2 throughout the frequency 
interval (Fig. 2). Further comparison is provided in Fig. 3a where the actually 
observed DTF values for n s = 50 are more spread than those in Fig. 3b for 
n s = 500. In the X 2 -+ Xi direction, (7) behaviour is readily confirmed. 

Even though bivariate DTF and PDC numerically coincide, the need to take 
into account A(A) inversion under the DTF’s mdl hypothesis can lead to overly 
conservative thresholds and consequent failure to properly reject Hq ifn s is small 
as in Fig. 1. 

Example 2 This example shows an oscillator X\{n) whose influence travels 
back to itself through a loop containing the 2 : 2 ( 71 ) —► 2 : 3 ( 71 ) link in the feedback 
loop pathway (Fig. f) and whose dynamics follows: 

Xi(n) = 0 . 95 ^X 1(71 - 1 ) - 0.9025x1 {n - 2) 

+0.35x3(71 — 1) + wi(n) 

22 ( 72 ) = 0.5xi (71 — 1) + 0 . 5 x 2(71 — 1) + 102 ( 71 ) 

x 3 (n) = x 2 (n - 1) - 0.5x 3 (n - 1) + w 3 (n) (9) 
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Figure 1: Comparison between DTF (middle row) and PDC (bottom row) for 
Ex. 1 showing the effect of the existing resonance (time series spectra top row) 
on threshold decision levels (dashed curves) using n s = 50 simulated data points. 
The effect of increasing n s can be appreciated in Fig. 2. Gray shades describe 
95% confidence levels when above threshold. 
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Figure 2: For n s = 500 a DTF single trial realization is safely above threshold - 
compare it to using n s = 50 in Fig. 1 (middle panel row). Gray shades describe 
95% confidence levels when above threshold. 
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Figure 3: Quantile distribution behaviour showing the distribution goodness of 
fit improvement as with sample size for Ex. 1 (n a = 50 (a) versus n s = 500 
(b)). Statistical spread decrease in the non-existing link x 2 —> X\ is evident as 
the improved normal fit of the x\ —> X 2 existing connection. For each value of 
n s , m = 2000 simulations were performed. 


7 



















































with the covariance matrix ofw given by 


S 


w 


1 5 0.3 

5 100 2 

0.3 2 1 


( 10 ) 


ensuring that X 2 (n) contributes a large amount of innovation power to the loop. 

Because iDTF deals well with unbalanced innovations, it was used with n s = 
500 (Fig. 5) andn s = 2000 (Fig. 6 ) points leading to the following features: (a) 
the large fDTF ^ 2 above 1 for some frequencies are due to the large innovations 
associated with X 2 .{n) in (10); (b) except for low lDTF values that require more 
points for reliable estimation, calculations confirm that signals originating at 
any structure reach all other structures; and (c) because of the much smaller 
relative power originating from X 3 (n), its influence is much harder to detect. 
The allied tPDC, also shown, confirms which immediate links are directionally 
active even for n s = 500. 

It is interesting to observe that \tDTF 23 1 2 has a peak around the x± reso¬ 
nance frequency which manifests itself because the innovations originating in X 3 
(W 3 (n)) are filtered by passing through the resonant filter represented by struc¬ 
ture x\ before reaching X 2 ■ This same type of influence is not so readily apparent 
(clear only at n s = 2000 ) in \lDTFi 3 \ 2 because the power contributed by X 3 is 
small with respect to that of other sources reaching x\ around that same resonant 
frequency. 

The sharp jump in \lDTFs 2\ 2 is a byproduct of the fast phase shift that takes 
place around x\ ’s resonance as X2 ’s signal travels through it to reach X3. 

A glimpse of the ensemble lDTF’s behaviour can be appreciated in Fig. 1 
showing how difficult it is to detect it if its values are low. 



Figure 4: Ex 2 loop connectivity structure. Signals from any structure reach all 
other structures. 


Example 3 The next example comes from [5], whose direct connections are 



a 



Frequency^) 


Figure 5: Ex. 2 information iDTF more widely spread results (a) contrasted 
to iPDC (b) results for n s = 500 and a = 0.05. Time series spectra are dis¬ 
played along the main panel diagonal (gray backgrounds). Sources are marked 
j (columns) and targets i (rows). 
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Figure 6: Improvement of connectivity estimates under n s = 2000 over Fig. 5 
single trial behaviour using iDTF (a) and iPDC (b). Time series spectra are 
omitted but can be appreciated from Fig. 5. Sources are marked j and targets 

i. 
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Figure 7: Ex. 2 iDTF quantile behaviour at A = 0.25 for to = 2000 simulations 
using n s = 500 (a) and n s = 2000 (b) data points. 
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contained in Fig. 8 and are dynamically described by: 


X\ (n) = 0.95^1(71 - 1) - 0.9025x1 (n - 2) 

+ 0 . 5 x 5(77 — 2) + w\(ri) 

X2 (77) = — 0.5x’i(?7 — 1 ) + W2{n) 

x 3 (77) = 0.4x 2 (77 - 2) + 7773(77) (11) 

X4 (ti) = —0.5x 3 (t7 — 1) + 0.25v / 2x4(ti — 1) 

+0.25^X5(77-1) + u?4(n) 

x^{n) = - 0 . 25 v / 2 x 4 (t 7 - 1 ) + 0 . 25 \Z 2 x 5 (n - 1 ) + 7775(77) 

At first sight, signal pathways exist between all structures, i.e. a signal orig¬ 
inating at any structure can reach all other structures. Note how difficult it is 
to pinpoint the X2 onto Xi influence even at n 3 = 2000 (Fig. 9 ) throughout the 
frequency domain interval. 

The dynamic system (11) was nonetheless designed to have zero influence 
at some frequencies as can be appreciated by the dip taken by \LDTF45 1 2 whose 
X5 —7 X4 influence cannot be detected at its minimum even at n s = 2000 (A = 
0.15;. 



Figure 8: Connectivity diagram for Ex. 3 showing that a signal traveling from 
any structure can reach any other structure. 


Example 4 This last example refers to the connectivity represented in Fig. 10 
and behaves dynamically according to 


Xi (77) = 0.95^x1(77 - 1 ) - 0 . 9025 x 1 (?7 - 2 ) 

+0.35x2(77 — 1) + 7771(77) 

X2 (77) = 0.5 x’i(t 7 — 1) + 0.5x2(77 — 1) + 7772(77) 

x 3 (77) = x 2 (t7 — 1 ) - 0.5x 3 (t7 — 1 ) + 7773(77) ( 12 ) 

whose DTF single trial behaviour can be appreciated in Fig. 11a and b for 
n s = 50 and n s = 500 respectively, while Fig. 12 sums up its ensemble behaviour 
between xi and x 3 . 
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Figure 9: Single trial tDTF results for the dynamic connectivity (n s = 2000, 
a = 0.01) in Ex. 3. Time series spectra are displayed along the main panel 
diagonal (gray backgrounds). Note that tDTF is significant for all pairs (except 
at some frequencies) confirming that signals from any structures can reach all 
others. Sources are marked j and targets i. 
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In this case, there is no X 3 influence on other time series, even though de¬ 
tection is more difficult at n s = 50 (Fig. 11) highlighting the importance of a 
sufficiently large sample even for such very simple dynamics. This is confirmed 
by the point quantile distributions in Fig. 12a (x\ —> X3) which are somewhat 
far from the theoretical asymptotic limit, being not yet quite normal compared 
to the Fig. 12b (x\ —> X3) case. 



Figure 10: Connectivity diagram between all structures for Ex. 4. Signals from 
X 3 do not reach the other structures. 


5 Discussion 

The present unified asymptotics for the DTF forms, introduced respectively in 
[16], [2] and [27], parallel the recent PDC developments in [3] and [22], confirm 
early DTF 

[16] threshold results [9] and provide estimator confidence intervals and thus 
pave the way for developing rigorous size effect comparisons using iDTF and 
tPDC under different experimental conditions. 

The allied PDCs presented here should not be confused with the purpose of 
many recent papers [31, 11, 10, 15] that compare connectivity techniques, DTF 
and PDC among them. 

Because many researchers often do not quite realize the conceptual differ¬ 
ences between DTF and PDC, this is a good time to stress that they intrinsi¬ 
cally measure different aspects of the connectivity between neural structures and 
neither is conceptually better than the other [15], complementary description 
aspects emerge when more than just two structures are simultaneously exam¬ 
ined. This is clear from Ex. 2 whose loop allows signals from any structures 
to reach all others - as illustrated by DTF’s null hypothesis rejection between 
all structures at least for some frequencies. By contrast PDC shows the overall 
direction signals travel within the loop of Ex. 2 by exposing the directional 
relationship between adjacent structures. 

Furthermore, it is also interesting to realize (Ex. 3) that it is entirely possible 
to have nonzero PDC between pairs of structures and zero DTF between them 
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Figure 11: Single trial DTF results for Ex. 4 with n s = 50 (a) and n s = 500 (b), 
using a = 0.01, reflecting the difficulty of inference if n s is low. Gray shades 
indicate 99% confidence level for above threshold jDTF| 2 . 
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Figure 12: Quantile DTF behaviour for Ex. 4 showing that under n s = 50 
the asymptotic normality for the existing link x\ —> X 3 is not yet reached (a) 
as opposed to (b) for n s = 500, using m = 2000 simulations in each case. 
Reasonable fit for the nonexisting reverse connection is observed for both n s 
values. 
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as happens for DTF from x$ to X 4 in this case in the neighbourhood of the 
network resonant frequency. 

Another DTF contribution as to network description is very well illustrated 
by the large intrinsic variance of 1 x 2 (X 2 in Ex. 2) ensuring that its influence is 
comparatively larger upon the other structures; its shape even (see |(DTF 32 | 2 
in Fig. 9a) reflects how its originating signal is filtered while traveling through 
multiple structures. PDC’s descriptive interpretations of the direct immediate 
link between structures can be further examined in [ 22 ]. 

This newly available objective possibility of performing rigorous hypothesis 
testing for both DTF and PDC opens up an interesting opportunity in describ¬ 
ing neural connectivity. Until now most connectivity has been discussed as 
either being ‘effective’ and/or ‘functional’, terms coined by [ 1 ] and which found 
widespread employment in functional neuroimaging [ 12 ] becoming cornerstone 
descriptive goals for the recent Connectonre effort (see www.connectome.org and 

[2i])- 

The popularity of ‘effective’ and ‘functional’ concepts is in line with dy¬ 
namical network structure descriptions that employ correlation, an undirected 
quantity that leads to undirected network graphs [29] that stems exactly from 
the traditional availability of rigorous means for quantifying its statistical relia¬ 
bility even in the light of evidence that its pairwise nature can lead to difficulties 
in accurate structural description [4]. 

Furthermore, the effective/functional terminology is confusing: the ‘effective’ 
term is reserved for situations when dynamical models of some kind are used for 
network portrayal whereas ‘functional’ usually refers to perceived statistically 
significant commonalities (correlations) of dynamical behaviour without special 
reliance on models. The confusion stems from the possibility of functional con¬ 
nectivity even without effective connectivity as when signal pairs covary under 
the spell of common hidden stimuli and no conceivable anatomical links between 
them. 

Through their complementary vistas on connectivity we have proposed a new 
“link” centered framework for network connectivity description [7] with PDC 
describing the immediate direct links between structures and DTF portraying 
how one structure ultimately influences another. In this new framework, di¬ 
rected links (as opposed to undirected ones as provided by correlation) are the 
central objects of interest. Links now can be classified according to their state - 
a directed link is in the direct-active state when PDC 7 ^ 0, in the indirect-active 
state if PDC = 0 and DTF 7 ^ 0, is direct-inactive for PDC = 0 and indirect- 
inactive when DTF = 0 as proposed in [23] with the present asymptotics for 
DTF and PDC [3] - affording the necessary operational state identification tools. 

Finally, Granger causality (GC), also popular in neural connectivity descrip¬ 
tions, has had conflicting defenses as to whether DTF or PDC, or even other 
quantities, represent it in the frequency domain. Part of the confusion stems 
from PDC’s immediate mirror of the Wald type likelihood ratio tests described 
as GC tests by [19]. Because DTF and PDC indistinguishbly reflect GC in 
the K = 2 time series case, but differentiate into distinct network descriptions 
for K > 2, it may worth be developing new terminology to match this dif- 
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ferentiation. Within the present link centered framework, we propose to split 
GC into the complementary views of Granger ‘connectivity’ in association with 
PDC (graph adjacency) and Granger ‘influenciability’ in connection with ‘DTF’ 
(graph reachability) both now possessing proper rigorous statistical quantifica¬ 
tion. Our present introduction of G-connectivity to describe immediate struc¬ 
tural active connections between structures as opposed to possibly long range 
influences (G-influenciability) has the intention of standardizing nomenclature 
and of organizing ideas in our newly proposed paradigm that emphasizes links 
rover structures as the latter must be significantly active in the first place for 
the meaningful analysis of their interplay to produce neural function. 


Appendix 


A Propositions 

To obtain the results in Sec. 3, specialized notation is needed. The first step 
is to represent the (3) as vector of real variables by means of the vec column 
stacking operator: 


h(A) = vec H(A) 

and whose associate real vector can be obtained by noting that 


h(A) 


i?e(h(A))l r T h(A) 
/m(h(A))J ' |h*(A) 


where * denotes complex conjugation and 


(A.l) 


(A.2) 


r 



i 

j 




(A.3) 


for j = \/^I. 

Also let 

<t = vec S w . (A.4) 

Together (A.l) and (A.4) can be combined in the parameter vector 0 T ( A) = 
[h T (A) * T ] T so that the problem of computing DTF, in all its forms, can be 
reduced to that of computing a ratio of quadratic forms 


_ h T (A)Iij<S„(er)I(jh(A) 
h T (A)Ii<Sd(<r)I?h(A) 


by employing the definitions 


I ij 0 

0 I ij 


(A.5) 


(A.6) 
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and 


(A.7) 


where 


h 0 

0 l t ’ 


1 . I ij whose entries are zero except for indices of the form ( l,mn ) = ((j — 
1 )K + i, ( j — 1 )K + i), which equal 1 whose purpose is to choose the i,j- th 
element of interest, while 

2 . I* is nonzero only for entries whose indices are of the form ( l,m ) : l = 
m = K(r — 1) + i, 1 < r < K, and chooses the i-th row of interest from 
the original (3) matrix, 

with S n (a) and <S<j(cr) which do not depend on A and take on different values 
according to the DTF form under consideration as listed in Table 1. 

The proof of (A.5) is immediate and follows of by direct substitution. 


A.l Main Asymptotic Results 

The chief basic result is the delta method [30] which rests on the continuous 
mapping nature of the parameters onto the statistics of interest in terms of n s 
and the Taylor expansion of the mapping. It is worth summing its content as: 

Theorem 1 If the distribution of v n = (iq, ..., tq) T estimated from n obser¬ 
vations converges in distribution as 

v/n(v„- M )4 A(0,£ v ). (A. 8 ) 


Let g(v) be a real-valued function with continuous partials of order m > 1 in 
the neighborhood of v = fi, with all the partials of order j with 1 < j < m — 1 
vanishing at v = fi and non-vanishing m-th order partials at v = pi. Then 


K 

{Vn) m {g{v n ) - g(fj,)) A ■ ■ ■ 

777 , Z — J 


i 1 = 1 
k 


E 

i m =1 


d m g 


dxi, ... dxi 


II z v 

X=/I v j= 1 


(A.9) 


with 

Z = (Z\....<Z k ) T ~ A’(().S v ), (A.10) 


wherefrom one can readily deduce the following consequence for large n and non 
null first derivatives in (A.9): 

Corollary 1 For a real differentiable function g(v) asymptotically distributed 
as in (A.8) then 

Vn{g{v n ) - g(L t))4jV(0,g T S v g) (A.ll) 

is the first delta method approximation where g = V v g is the gradient of g(v) 
computed at fi [ 24 ]- 
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Remark 1 Though defined for a scalar function of a vector the results from 
Corollary 1 remain valid for a vector function where g then equals the Jacobian 
of the transformation rather than the gradient see p. 26 Sec. 3.1 in [30]. 


A.2 Asymptotic 6 Behaviour 

Proposition 1 The asymptotic properties of 0’s are given by 



yfiT a {6-0)A U(0Me) 

(A.12) 

where 

o r«h o- 

[ 0 fi CT 

(A.13) 

with 

n h (A) = 

(A. 14) 

for 

U(X) = 

’i?e(H T (A) 0 H(A)) —Jm(H r (A) 0 H(A))" 

Jm(H T (A) 0 H(A)) i?e(H T (A) 0 H(A)) 

(A.15) 

and 

Q _ “2 ( 

Cl a fl a ’ 

(A.16) 

where fl a is the 

covariance matrix of 



a = uec[A(l) A(2) ... A(p)] 

(A.17) 

given by fl a = T 

x 1 0 where T x = i?[x(n)x T (n)] for 



x(n) = [xi(n).. .x K {n).. ■ 



xi(n -p+l)... x K (n -p + 1)] T ; 

(A.18) 

and 

= 2 DkD^(S w 0 £ w )D^ t D^ 

(A.19) 

with Dj, standing for the Moore-Penrose pseudo-inverse of the standard dupli¬ 
cation matrix [19] and 

C(A) = —S(A) ’ (A ' 20) 

whose blocks are 

K 2 x pK 2 dimensional of the form 



C(A) = [Ci(A)... C P (A)] 

(A.21) 

and 

S(A) = [Si(A)... S P (A)], 

(A.22) 

for 

C,,(A) = diag([cos(2nrX)... cos(27rrA)]) 

(A.23) 

and 

S r (A) = diag{[sin{2TTr\)... sin{2-Kr\)]). 

(A.24) 
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Table 2: Defining variables according to DTF type in (A.5) 


variable 

DTF 

DC 


zDTF 

<->n 

12 K 2 

1 2 © (IK © E w ) 

1 © I K 

I2 © (Ik © S w ) ® Ik 

Sd 

I2 K 2 

I2 © (Ik © S w ) 

1 © I K 

I2 © S w <g> I k 


Proof 


The proof follows by noting that h(A) is a function of a(A) given by 


a (A) 


vec(Re( A(A))) 


vec(I pK 2 ) 

vec(Im( A(A))) 


0 


— C(A)a 


(A.25) 


whose covariance matrix is given by (A. 16) and is asymptotically independent 
from <j whose covariance is (A. 19) as shown in [3]. 

To obtain fih, first note that the gradient of h in (A.l) can be obtained from 


V a h = -H T <8) H (A.26) 

omitting the explicit A dependence to simplify notation, in view of (3) in Eq. 
(1) from See Sec. 10.6, p. 198 in [18]. 

By writing 


V a h 

V ah* 


h t ®h 

0 


0 

-(H T <g>H) 



and multiplying by T defined in (A.2) leads to 


V a h 


r 


'-H t ® H 

0 


0 

-(H T <g>H)* 


T -i 


= n 


(A.27) 


(A.28) 


Therefore the result of Remark 1 implies (A. 14) and this completes the proof. 


□ 


A.3 Confidence Interval Theorem 

Proposition 2 Omitting the explicit frequency A and u dependencies to sim¬ 
plify notation, the confidence interval results 

v / ^(l%| 2 -|7 i i| 2 )^A(0, 7 2 ), (A.29) 

where n s is the number of observations and 

7 2 = gh^hgh + sMagl, (A.30) 
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Table 3: Defining variables according to DTF type in (A.32) 


variable 

DTF 

DC 

/DTF 


0 

diag(vec(lK)) 

diag(vec(lK)) 


0 

diag(vec(lK)) 

I K 2 


for 


gh 


uTtc o tc 

■ I Hj&nHj 

h T I?5 d I?h 


,h T W| h 

(a^I?5 d I I c h)2 


h J L c 5 rf I? 


and 

g " = hnfg„i;h [ (l; J h)T ® (hTl «>] 

where the values of £ n and $, d are listed on Table 3 and 

&k = (I 2 <8 T K 2 2 <8 Ik 2 ) 

[wec(I 2 ) 8 (Ik 8 T Pa 8 Ik)(Ik 2 8 vec(I K ))\ 

with T L t M standing for the commutation matrix [19]. 


(A.31) 


(A.32) 


(A.33) 


When the innovation covariance is known a priori or does not need to be 
estimated, the term g a fl a gf. in (A.30) is zero. 

Proof 


This proposition is an immediate consequence of Corollary 1 given the results 
of Proposition 1 by rewriting (A.5) as 


7(0) 


7n(0) 
7 d{0) 


h(A) T I^.5„( < r)I9 ? .h(A) 

h(A)^5 d ( < T)I®h(A) 


(A.34) 


All one needs is to properly compute its gradient or that of its transpose. 
The job is further simplified by noting the asymptotic independence of h and er 
for this allows their separate consideration as Tig is block diagonal. 


Since DTF is a ratio (see (A.5)) one may write the transpose of the required 
gradients as 


9t/^ 


7d 


7 d 


9q „ 
dip 1 


djd 

' dxp T J 


(A.35) 


where ip represents either h or er and respectively leads to gh and g CT . 
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Therefore the necessary gradients operate on the required defined quadratic 
forms whose general differentiation with respect to h yields 


<9(h T I c <SI c h) 


2h T rsr 


(A.36) 


see p. 175 Eq. (2) in [18] 


since all appropriately valued I C <SI C matrices are symmetric. Inserting the terms 
in (A.35) leads to (A.31). 

The nested dependence of 7 (0) on cr calls for chain rule use: 


where 


d{h 7 I c SI c h) <9(h r F<SI c h) DS 

~ as dto* 

see p. 183 Eq. (3) in [18] 


(A.37) 
(A.38) 


In its general form, S = I2 <g> S (g> Ik ( see Table 2). Thus, by the chain rule 


where 


ds ds as 


(A.39) 


dS 

—= = & K = (I 2 (g) Tk 2 ,2 ® I K 2 ) 

00 

[vec( I 2 ) ® (I k ® T K 2 tl (gi I K )(I K 2 (g) vec(I K ))\ (A.40) 

(see p. 184 Eq. (13) in [18]). 

All that is left to compute are the derivatives of S in each case (as in Table 
2). For for each possible S value, one has 

di K 2 


da T 


= 0 


which follows from its lack of cr dependence in this case. 
When S = E w , 

c>E w 

d(r T 1 k 2 - 

Finally considering S = Ik Q E w leads to 


(A.41) 


(A.42) 


? = diag(vec( I K )) (A.43) 

see p. 185 eq. (16) in [18]. 

These results are summarized as and quantities that appear on Table 3 
and comprise (A.32). 

The use of Slutsky’s lemma concludes the proof by allowing the use of esti¬ 
mated quantities. 


□ 
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A.4 Null Hypothesis Test 

Under the null hypothesis 

H 0 : |7u| 2 =0 <J=M&h = 0 (A.44) 

both (A.31) and (A.32) equal zero, and (5) no longer applies so that the next 
Taylor term becomes necessary [24] weighted by one half of PDC’s Hessian at 
the point of interest with an Ofaj 1 ) dependence. Via a device similar to that 
used in [25], one can show that 

Proposition 3 Under (A.44) 


n s (hW?h)(|7i/ - | 7ij | 2 ) 4 hxl (A.45) 

fc=l 

where Ik are the eigenvalues ofT> = L T I?.«S n I£.L, where L is the Choleski factor 
o/« h . Furthermore q = rank{V) < 2, its value is 1 whenever A € {0,±0.5}. 

The result in (A.45) amounts to a linear combination of xf variables whose 
relative weights depend on estimated parameter and covariance values. Keep in 
mind that f2h depends on A (see eq. (A.14)). 


□ 


Proof 

In view of the generalized delta method version, Theorem 1 whose conditions 
call for use of m = 2 under H 0 (A.44) since both (A.31) and (A.32) become 
nullified. 

First of all, note that taking derivative of (A.31) and (A.32) with respect 
to it a second time does not alter the I® -a dependence and so also produces 
null results. The same holds when deriving (A.32) with respect to a since it is 
quadratic in I?-a. 

By contrast, the only nonzero surviving term is that of taking the derivative 
of (A.31) with respect to a, which, under Hq, reduces to 

^ T c C TC 

h T IfS d Ifh ij n ij ‘ 

Therefore the Hessian in (A.9) only has an upper nonzero block correspond¬ 
ing to the derivative of (A.31) with respect to h so that one only needs to 
consider the distribution of the latter to write 

n a (h T I^h)(|%-| 2 - | 7ii | 2 ) 4 (A.46) 

using Theorem 1 for x 4 A"(0, flh)- The use of Slutsky’s lemma concludes the 
first part of the proof by allowing the use of estimated quantities. 
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Diagonalization of x T I?-«S n I?-x is done via a transformation through the 
matrix L obtained from the Clroleski decomposition of fih = LL 2 • By making 
x = Ly, where L = <Sn /2 I^L, yields x T I^5„I^-x = y T LI c lj S n I^ j Ly = y T Dy 
so that the elements of the vector y = (L T L) _1 L T x are made mutually inde¬ 
pendent zero mean and of unit variance. Now diagonalizing D = UAU T with 
UU T = I gX9 produces 

y T °y = h y T u fc u£y = ^ l k (l (A.47) 

k —1 k -1 

where u k is the fc-th column of U. It is easy to show that the variables Cfc = y 
are mutually independent, normal zero mean and of unit variance so that C, k are 
Xi random variables. 

As ranfc(X) = rank(X . T ) and 

rank{K Y) < min(rank(X.),rank(Y)), 

it follows, after recalling explicit A dependence, that 

rank{ D) = rank{h T ll J S n l c lJ 'L) 

= rank{LL T I^S n r i:j ) 

= ranfc(n h (A)I?-5 n I?-) 

= rank('H{X)C(X)Cl a C T (X)'h T (A.48) 

which is upper bounded by rank{ I?-) = 2. It is readily verified that, when 
A £ {0,±0.5}, rank(C(X)) = 1 imposes the upper bound thus concluding the 
proof. As for the PDC case [3] if the model order p = 1, though a detailed proof 
is more involved, one can show that the rank of C T (A)"H T (A)iy equals 1 as it 
has only a single row that is not identically zero. 

□ 
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